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Abstract. We study the modulational instability of periodic traveling waves 
for a class of Hamiltonian systems in one spatial dimension. We examine how 
the Jordan block structure of the associated linearized operator bifurcates for 
small values of the Floquet parameter and derive a criterion governing insta- 
bility to long wavelengths perturbations in terms of the kinetic and potential 
energies, the momentum and the mass of the underlying wave as well as their 
derivatives. The dispersion operator of the equation is allowed to be nonlocal, 
for which Evans function techniques may not be applicable. We illustrate the 
result by discussing equations of Korteweg-de Vries type. 



1. Introduction 

We study the stability and instability of periodic traveling waves for a class of 
Hamiltonian systems in one spatial dimension, in particular, equations of Korteweg- 
de Vries (KdV) type 

(1.1) u t -Mu x + f{u) x = 

in the theory of wave motion. Here t £ K is typically proportional to elapsed time 
and x £ K is usually related to the spatial variable in the primary direction of wave 
propagation; u — u(x, t) is real valued, frequently representing the wave profile or a 
velocity. Throughout we express partial differentiation cither by a subscript or using 
the symbol d. Moreover M. is a Fourier multiplier defined as Mu(^) = m(£)u(£), 
characterizing the dispersion in the linear limit, while / determines the nonlincarity. 
In many examples of interest, / obeys a power law. 

Perhaps the best known among equations of the form (1.1) is the KdV equation 

u t + u xxx + (u 2 ) x = 

itself, which was put forward in [Bou77] and [KdV95] to model the unidirectional 
propagation of surface waves with small amplitudes and long wavelengths in shallow 
water; it has since found relevances in other situations such as Fermi-Pasta-Ulam 
lattices (see [FPU55], for instance). Observe, however, that (1.1) is nonlocal unless 
the dispersion symbol m is a polynomial of i£. Examples with nonlocal dispersion 
include the Benjamin-Ono equation (see [Ben70] and [Ono75]) and the intermediate 
long wave equation (see [Jos77]), for which m(£) = |£| and £ coth£ — 1, respectively, 
while f(u) = u 2 . Another interesting example, proposed by Whitham [Whi74] to 
describe "breaking" of shallow water waves, corresponds to m(£) — J tanh £ /£ and 
/(it) = u 2 . Incidentally the quadratic nonlinearity is characteristic of many wave 
phenomena. 
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A traveling wave solution of (1.1) takes the form u(x, t) = u(x + ct), where c€l 
and u satisfies by quadrature that 

(1.2) Mu- f(u)-cu-a = 

for some a £ R. In other words, it steadily propagates at a constant speed without 
changing the configuration. For a broad range of dispersion symbols and nonlineari- 
ties, a plethora of periodic traveling waves of (1.1) may be attained from variational 
arguments, e.g., the mountain pass theorem applied to a suitable functional whose 
critical point satisfies (1-2). The associated spectral problem 

/j,v = Mv x - (f'(u)v) x - cv x 

is the subject of investigation here. 

As Alan Newell explained in [New85] , "if dispersion and nonlinearity act against 
each other, monochromatic wave trains do not wish to remain monochromatic. The 
sidebands of the carrier wave can draw on its energy via a resonance mechanism, 
with the result that the envelop becomes modulated." Benjamin and Feir [BF67] and 
independently Whitham [Whi67] formally argued that Stokes' periodic waves at the 
surface of deep water would be unstable to perturbations by certain, small frequency 
waves, namely the modulational or Benjamin-Feir instability. Corroborating results 
arrived about the same time by Lighthill [Lig65], Ostrovsky [Ost67], Benney and 
Newell [BN67], Zakharov [Zak68a, Zak68b], among others. See also [Whi74] and 
references therein. Modulational instability occurs in numerous physical systems 
such as optics (see [Ost67,Zak68a, AL84,THT86,HK95], for instance) and plasmas 
(see [Has72,MB89], for instance). 

Recently an extensive body of work has aimed at translating the formal modu- 
lation theory in [Whi74], for instance, into rigorous mathematical results. It would 
be impossible to do justice to all advances in the direction, but we single out a few 

[OZ03a, OZ03b, Scr05] for conservation laws with viscosity, [DS09] for nonlinear 
Schrodingcr equations, and [BJ10,JZ10] for equations of KdV type. Sec [BM95] for 
the Benjamin-Feir instability of Stokes' waves in a channel of finite depth. 

In particular in [BJ10] a rigorous calculation of long wavelengths perturbations 
was made for (local) KdV equations with general nonlinearities, henceforth called 
generalized KdV equations, via Evans function techniques as well as the Bloch wave 
decomposition. Under certain nondegeneracy conditions, specifically, the spectrum 
of the associated linearized operator in the vicinity of the origin was shown to take a 
normal form — either the spectrum consists of the imaginary axis with multiplicity 
three or it contains three lines through the origin, one in the imaginary axis and two 
in other directions; the latter implies instability. In addition the normal form was 
determined through an index, which was effectively calculated in terms of conserved 
quantities of the PDE, together with their derivatives with respect to constants of 
integration arising in the traveling wave ODE. 

Here we take matters further and derive a criterion governing spectral instability 
near the origin of periodic traveling waves for a general class of Hamiltonian systems 
in one* spatial dimension. We shall make a few structural assumptions — mainly 
the existence of a conserved momentum and a Casimir invariant, interpreted as the 
mass — but do not otherwise restrict the form of equations, considerably broadening 



"The assumption that the equation is set in one spatial dimension merely enters in the deriva- 
tion of a Pohozaev type identity, which is to avoid inversion of a linearized operator; see Lemma 2.9. 
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the scope of applications. Of particular interest is the case of nonlocal dispersion, for 
which Evans function techniques 1 and other ODE methods (which are instrumental 
in [BJ10], for instance, in the derivation of index formulae) may not be applicable. 
Instead we perform a spectral perturbation of the associated linearized operator in 
terms of the Floquet parameter and substitute ODE based approaches by functional 
analytic ones. Note that variational properties of the equation help us to determine 
the stability index without recourse to the small amplitude wave limit. Lin [Lin08] 
devised a continuation argument to generalize the stability theory of solitary waves 
in [GSS87,BSS87,PW92], among others, to a class of nonlinear nonlocal equations; 
see [HJ12] for an adaptation in the periodic wave setting. 

Our results are most explicit in the case of KdV type equations with fractional 
dispersion, which we will illustrate in Section 3 and Section 4. In particular we shall 
determine the modulational instability index in terms of the kinetic and potential 
energies, the momentum and the mass of the underlying wave train, together with 
their derivatives with respect to Lagrange multipliers for the traveling wave equation 
as well as the wave number. In the case of the quadratic power-law nonlinearity 
we shall further express the index in terms of the potential energy, the momentum 
and the mass as functions of Lagrange multipliers associated with conservations of 
the momentum and the mass. 

2. Abstract framework 

We shall derive a sufficient condition for spectral instability to long wavelengths 
perturbations of periodic traveling waves, for a class of Hamiltonian systems in one 
spatial dimension under a few structural assumptions. They will be stated as they 
are needed. 

2.1. Preliminaries. Consider a Hamiltonian system of the form 
(2.1) ut = J8H(u), 

where J is a linear skew-symmetric operator, independent of u, H is a Hamiltonian 
and 8 denotes variational differentiation. 

Throughout we will work in the L 2 -based Sobolev space setting. We employ the 
notation (,) for the L 2 -inner product. 

Assumption 2.1 (Conservation laws). Assume that (2.1) possesses in addition to 
H two conserved quantities, denoted P and M. Assume that H, P, M are smooth 
in an appropriate function space and invariant under spatial translations. Moreover 
assume that 

(P) JSP(u) = u x , 

(M) ker(J) = span{<5M(u)}. 

We refer to P and M as the momentum and the mass, respectively. Assumption 
(P) states that P generates spatial translations while assumption (M) implies that 
M is a Casimir invariant of the flow induced by (2.1). Thanks to Noether's theorem, 
conservation of the momentum is expected whenever (2.1) is invariant under spatial 
translations. 

'We note, however, that the approach in [GLM07, GLZ08], for instance, realizing the Evans 
function as a regularized Fredholm determinant may be more generally applicable than the stan- 
dard ODE based formulation. 
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Equations of KdV type in (1.1) satisfy Assumption 2.1, where J = d x , 
H = j (^uMu - F(u)) dx, F' = /, 

P = j iu 2 dx and M = J u dx. 

More generally, if L is a positive Fourier multiplier then 

Lu t - Mu x + f{u) x = 
satisfies Assumption 2.1, where J = L~ 1 d x , 

H = j {^uMu - dx, 

P = I -uLu dx and M = I u dx. 
J 2 J 

Examples include the Bcnjamin-Bona-Mahony equation. 

A traveling wave solution of (2.1) takes the form u(x, t) = u(x + ct + so): where 
c e M represents the wave speed, .x € M is the spatial translate and it satisfies that 

(2.2) cu x = JSH(u). 
Or equivalently, u arises as a critical point of 

(2.3) E(u;c,a):=H(u)-cP(u)-aM(u) 
for some a G R. In other words, it satisfies that 

(2.4) 5E(u;c,a) = 0. 
Indeed, since 

(SM(u),u x ) = / M(u) x dx = 

it follows from (M) that m x is orthogonal to ker(J). Applying J -1 to (2.2) we then 
find that (P) implies (2.4). 

Assumption 2.2 (Periodic traveling waves). Assume that (2.1) admits a smooth, 
four-parameter family of periodic traveling waves, denoted u(- + x ;c,a,T), satis- 
fying (2.2), or equivalently (2.4), where u is even and T-periodic for some T > 0, 
the period. 

The existence of periodic traveling waves of (2.1) usually follows from variational 
arguments. To illustrate, we shall discuss in Proposition 3.2 a minimization problem 
for a family of KdV equations with fractional dispersion. The symmetry assumption 
is to break that (2.1) is invariant under spatial translations. 

Differentiating (2.4) with respect to x and c, a, respectively, we use (P) and (M) 
to obtain that 

(2.5a) 5 2 Eu Xo = 0, J5 2 Eu Xo = 0, 

(2.5b) 5 2 Eu c = SP, J5 2 Eu c = u x = u xo , 

(2.5c) S 2 Eu a = 5M, JS 2 Eu a = 0. 

Moreover 

(2.6) M c = (SM, u c ) = (6 2 Eu a , u c ) = (u a , S 2 Eu c ) = (u a , SP) = P a . 



MODULATIONAL INSTABILITY 



5 



Remark 2.3. Perhaps (2.5a) through (2.5c) are familiar to readers from thermody- 
namics, where the free energy — E in the present setting — serves as a generating 
function of various quantities of interest. Specifically they are found as appropriate 
derivatives of the free energy with respect to the Lagrange multipliers for the asso- 
ciated variational problem. The equality of mixed partial derivatives then leads to 
relations among their derivatives, known as Kirchhoff's equations. 

Remark 2.4. The period T enters calculations in a slightly different manner from 
other, periodic traveling wave parameters x , c, a. Although 5 2 Eut = 0, formally, 
i.e., with the set of smooth functions as the domain of S 2 E, nevertheless, ut is not 
in general T-periodic. Rather ut exhibits a secular growth, linear in x. Later we 
shall take a linear combination of ut and xu x to form a T-periodic function and 
construct a Pohozaev type identity. 

Here and in the sequel, we may regard H , P, M, evaluated at a periodic traveling 
wave u(-+x ; c, a,T) of (2.1) and restricted to one period, as functions of c and a, the 
Lagrange multipliers associated with conservations of the momentum and the mass, 
respectively, as well as the period T. Therefore we are permitted to differentiate 
H , P, M with respect to the periodic traveling wave parameters c, a, T. We shall 
ultimately derive a modulational instability index in terms of H, P, M together 
with their derivatives with respect to c, a, T. Corresponding to the translational 
invariance of the equation, xq plays no significant role in the present development. 
Hence we may mod it out. 

Linearizing (2.1) about a periodic traveling wave u = u(- ;c,a,T) in the frame 
of reference moving at the speed c, we arrive at that 

(2.7) Vt = JS 2 E(u; c, a)v =: C(u; c, a)v. 

Seeking a solution of the form v(x,t) — e^ t v(x), we in turn arrive at the spectral 
problem 

(2.8) \iv = £(u; c, a)v. 

We then say that u is (spectrally) unstable if the L 2 (M)-spectrum of £ intersects 
the open, right half plane of C. Note that v needs not have the same period as u, 
namely a modulational or sideband perturbation. 

In the case of the (local) generalized KdV equation 

(2.9) u t + u xxx + f(u) x = 0, where / is a nonlinearity, 

one may relate the spectrum of the associated linearized operator to eigenvalues of 
the monodromy map (or called the periodic Evans function). As a matter of fact, a 
study in [BJ10] of the characteristic polynomial of the monodromy map led to two 
kinds of stability indices. The first counts modulo two the total number of positive 
eigenvalues in the periodic functions setting and it generalizes that governing the 
stability of solitary waves in [GSS87,BSS87,PW92], among others. The second, on 
the other hand, furnishes a sufficient condition for instability to long wavelengths 
perturbations and it makes rigorous the formal modulation theory in [Whi74], for 
instance. The present purpose is to generalize the notion of the second index to a 
general class of Hamiltonian systems, allowing nonlocal dispersion, for which Evans 
function techniques and other ODE methods may not be applicable. Instead we rely 
upon a Bloch wave decomposition of the associated spectral problem. Lin [Lin08] 
utilized a continuation argument to generalize the first index to a class of nonlinear 
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nonlocal equations in the solitary wave setting; see [HJ12] for an adaptation in the 
periodic wave setting. 

It is standard from Floquet theory (see [Chi06] , for instance) that any eigenfunc- 
tion of (2.8) takes the form 

v(x) = e lTX (j)(x), where <j> is T-periodic and r G (— n/T, tt/T] 

denotes the Floquet parameter. Accordingly (2.8) renders the one-parameter family 
of spectral problems 

(2.10) = e~ iTX C(u; c, a)e iTX (j) =: C T (u; c, a)<j), 

suggesting us to study Lp er ([0, T])-spectra of C T . Notice that the spectrum of C T 
consists merely of discrete eigenvalues. Moreover it is standard from Floquet theory 
that spcc i2(R) (£) = U r s P ec L2 er ( [0 ,T]) (AO- 
One does not expect to be able to compute the spectrum of C T for an arbitrary r, 
however, except in few special cases, e.g., completely integrable systems; we refer 
the reader to [BD09], for instance. Instead we are going to restrict the attention to 
when the Floquet parameter r and the eigenvalue \i are both small. Physically this 
amounts to long wavelengths perturbations or slow modulations of the underlying, 
periodic traveling wave. Specifically we will study the spectrum of the unmodulated 
operator Co = C &t the origin. Note that zero is an eigenvalue of Co, thanks to the 
latter equations in (2.5a) and (2.5c). We will then examine how the spectrum near 
the origin of the modulated operator C T bifurcates from that of Co for |t| small. 

We promptly discuss "nondegeneracy" assumptions for a periodic traveling wave 
of (2.1), under which the generalized Lp er ([0, T])-null space of Co = C supports a 
Jordan block structure. 

Assumption 2.5 (Nondegeneracies) . Assume that 
(Nl) u(- ; c, a, T) is not constant; 
(N2) ker(S 2 E(u;c,a)) — span{u x }; 
(N3) G := M c P a - M a P c £ 0. 

In what follows, we employ the notation 

(2-11) {f,9}x,y = fx9y- fy9x 

and we may write G = {M, P} c , a - 

Assumption (Nl) means that the underlying, periodic traveling wave is nondc- 
generate. It is not a serious assumption since if the profile of the underlying wave is 
constant then the stability analysis is easy. In the case of the quadratic nonlinear- 
ity, for which the related, time evolution equation enjoys the Galilean invariance, 
this amounts to understanding the stability of the zero state. 

Assumption (N2), on the other hand, means the nondegeneracy of the linearized 
operator associated with the traveling wave equation; that is, the kernel is spanned 
merely by spatial translations. It proves a spectral condition, which plays a central 
role in the stability of traveling waves (see [Wei87,Lin08] among others) and in the 
blowup analysis (see [KMR11], for instance) for the related, time evolution equation, 
and it necessitates a proof. Indeed one may cook up a polynomial nonlinearity, say, 
f(u), for which the kernel of —d 2 — f'(u) at the underlying wave is two dimensional 
at isolated points. 
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In the case of (local) generalized KdV equations (sec (2.9)), the nondegeneracy 
of the linearization at a periodic traveling wave was identified in [BJ10] with the 
requirement that the wave amplitude not be a critical point of the period; moreover 
it was verified in [Kwo89], among others, at ground states in all dimensions. By a 
ground state, incidentally, we mean a traveling wave solution that is positive and 
radial and which vanishes at infinity. These proofs utilize shooting arguments and 
the Sturm-Liouville theory for ODEs, and they may not be applicable to nonlocal 
operators. Nevertheless, Frank and Lenzmann [FL12] recently demonstrated (N2) 
at ground states for a family of nonlinear nonlocal equations, which we shall follow 
in Proposition 3.5. 

Assumption (N3) implies that the mapping (c, a) i— > (P, M) is of C 1 and locally 
invertible, namely the nondegeneracy of the constraint set for the periodic, traveling 
wave equation. We shall verify it in Lemma 3.10 in the case of KdV equations with 
fractional dispersion near the solitary wave limit. Notice that G may vanish along a 
curve of co-dimension one. As a matter of fact, we shall discuss later that a change 
in the sign of G signals an eigenvalue of S 2 E crossing from the left half plane of C 
to the right through the origin. 

Lemma 2.6 (Jordan block structure). Under Assumption 2.1, Assumption 2.2 and 
Assumption 2.5, the generalized null space of Cq = C${u\ c, a) acting on Lp er ([0, T]) 
possesses the Jordan block structure: 

(Jl) dim(kcr(£ )) = 2, 

(J2) dim(kcr(£2)/kcr(£ )) = 1, 

(J3) dim(ker(££ +1 )/ker(£ft)) = for n ^ 2 an integer. 
Specifically 



Proof. Note from the latter equations in (2.5a) and (2.5c) that vi,v 2 <E ker(£ )- 
Note from Assumption 2.2 that v\, v 3 , wi,w 3 are even functions and v 2 , w 2 are odd. 
Since v 2 ^ by (Nl), it follows from the former equations in (2.5a) and (2.5c) that 
vi and v 2 are linearly independent. Since (N2) implies that ker(£o) is a t most two 
dimensional, therefore, ker(£o) = span{i>i, i^}. A duality argument then leads to 
that ker(£j) = span{<5M, SP} and, furthermore, (N3) implies that w\ and w 3 form 
a basis of ker(£j). 



(2.12a) v x := u a , tui := M C SP - P C SM, 

(2.12b) v 2 := u x , w 2 := J- x {M a u c - M c u a ), 

(2.12c) v 3 := u c , w 3 := P a 6M - M a 6P 

form bases of the generalized null eigenspaces of Cq and C\, i.e., 
(2.13a) £ vi = 0, C\ Wl = 0, 

(2.13b) £o«2=0, Clw 2 =w s , 

(2.13c) £ «3 = v 2 , £ f w 3 = 0. 

Here and elsewhere, the dagger means adjoint. Moreover 
(2.14) ( Wj ,v k ) = (M c P a - M a P c )8 jk = G5 jk , 
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To proceed, notice that V3 e ker(£Q), obviously, but V3 ^ ker(£o) by (Nl). If 
v € ker(£o)/ ker(£o) then Cqv — v\, which in light of (N3) admits no solutions other 
than w 3 by the Fredholm alternative. A dual statement follows mutatis mutandis, 
noting that M a u c — M c u a is orthogonal to 5M and thereby is in range(J). Similarly 
ker(£g)/ ker(£p) is empty since £ V = v 3 admits no solutions by the Fredholm 
alternative. □ 

In case G = 0, the Jordan block structure of the generalized null space of Cq is 
necessarily larger than (J1)-(J3). Since (wj,Vk) = for j ^ k, indeed, either there 
must be an element in ker(£j) which is linearly independent of vi and v 2 , or since 
vj's would then lie in ker(£j) ± = range(£o)> there must be elements in ker(£p) and 
kcr(£g), linearly independent of W3. 

Here and elsewhere, the subscript _L means the orthogonal complement. 

In the case of the (local) generalized KdV equation (see (2.9)), whose traveling 
wave equation reduces by quadrature to 

(2.15) i?4 + F ( u ) + \ cu2 + au = b, where F' = /, 

for some iel, stability indices were effectively calculated in [BJ10], for instance, 
in terms of P, M, T as functions of c, a, b (although the results may be restated in 
terms of H, P, M). When dealing with abstract Hamiltonian systems, however, the 
second constant of integration b may not be available and we opt to choose T as a 
periodic traveling wave parameter instead. We shall then express the modulational 
instability index in terms of H, P, M as functions of c, a, T. The present approach 
seems to have added advantages that u a , u x , u c are T-periodic, as opposed to in 
[BJ10], and they form a basis of the periodic, generalized null space of £0, m link 
with variational properties of the equation. Formulae do become cumbersome, but 
in the absence of the extra feature that an additional quadrature furnishes, this 
seems the only way forward. 



2.2. Jordan block perturbation and modulational instability. Let u(-- c, a, T) 
be a periodic traveling wave of (2.1), satisfying Assumption 2.2 and Assumption 2.5. 
This subsection concerns the L? er ( [0, T])-spectrum of C T {u: c, a), in (2.10), near the 
origin for |r| small, for which a Baker-Campbell-Hausdorff expansion reveals that 

(2.16) £t(u; c, a) = Lq(u: c, a) + irLi(u; c, a) — -t 2 L2(m; c, a) + ■ ■ ■ , 
where 

(2.17) L (u;c, a) = £ (w;c, a), Li(u; c, a) = [L , x], L 2 (u; c, a) = [Li, x], 

and so on. Notice that L , £1, £ 2 , . . . are well-defined in Lp er ([0, T}) even though x 
is not. In the case of the (local) generalized KdV equation (see (2.9)), for instance, 

L = d x {-d 2 x - /(«) - c), Li = -3^ -/(«)- c, L 2 = -68 x . 

Recall from Lemma 2.6 that zero is a generalized Lp er ([0, T}) -eigenvalue of Co, 
with algebraic multiplicity three and geometric multiplicity two, with a basis {vj} 
and a dual basis {wj}, j — 1,2,3, of the generalized null space, satisfying (2.13a)- 
(2.13c) and (2.14). For |r| small, thereby, three eigenvalues of C T bifurcate from the 
origin. We shall determine when bifurcating eigenvalues of C T leave the imaginary 
axis to derive a modulational instability index. 
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Varying r in (2.10) for |t| small, in view of (2.16), we arrive at the perturbation 
problem 



where //, e £ C are near fi = 0, e = and <j> £ L 2 er ([0, T]). Note that e is related to 
the Floquet parameter r via e = it. 

Eigenvalues of (2.18) in the neighborhood of the origin in general bifurcate merely 
continuously in the perturbation parameter e, but not in the C 1 manner. Rather 
they admit Puiseaux series in fractional powers of e. Requiring that 

(2.19) (tui,Li«2)=0 and (w 3 ,L 1 v 2 )=0, 

however, eigenvalues do depend upon the perturbation parameter in the C 1 manner; 
a proof based upon the Frcdholm alternative may be found in [BJ10, Theorem 4]. 
In applications in Section 3 and Section 4, we shall in fact show that 

(2.20) (wj,Lgv k ) = whenever j + k + £ is even, 
where j, k = 1, 2, 3 and I = 0, 1, 2. Hence we may posit that 

(2.21) //(e) = e//i + e 2 // 2 H and 0(e) = </> + efa + e 2 </> 2 H ■ 

For generalized KdV equations (see (2.9)), incidentally, the eigenvalue bifurcation 
is analytic. 

Note from the Fredholm alternative that Lo<p — b is solvable if b £ range(Lo) = 
ker(Lj)- 1 - and the solution is defined up to an element in ker(L )- Below we will write 
the solution as <j> — L^b, with the understanding that range(Lg 1 ) _L span{u>i, w 2 }- 
As a reminder, 

(2.22) ker(L ) = span{«i, v 2 } and range(io) = spanjwi, W3} . 

Substituting into (2.18) the eigenvalue and eigenfunction representations in (2.21), 
at the order of e° = 1, 



whence tfio — c\Vi + C2V2 for some ci, c 2 € C. 
At the order of e, correspondingly, 

L 4>i + Li<j) = fJ,i<t>o, 
which by virtue of the Fredholm alternative is solvable if 

=(wi, (//1 - Li)0o) = ci(ni(wi,vi) - (wi,LiVi)) + c 2 (/i 2 (wi,w 2 ) - (wi,Liv 2 )), 
=(w 3 , (//1 - Li)<po) = ci(fj,i(w 3 ,vi) - (w 3 ,LiVi)) + c 2 (^ 2 («7 3 ,w 2 ) - (w 3 ,Liv 2 )). 

Since the last terms on the right sides vanish by (2.19), these reduce with the help 
of (2.14) to that 

ci((w\, L\V\) — fJ,\G) = and ci(w 3 , L\Vi) = 0. 

Therefore, c\ = 0^ and 

(2.23) 0o = c 2 w 2 , 4>\ = c 2 Lq 1 (fi - Lx)v 2 + c 3 vi. 

*This implies that the kernel of L$ is spanned by two elements while Lq + eLi, three eigen- 
functions for e small but non-zero, while in the limit as e — > three cigenfunctions attain the same 
limit. Numerical experiments bear this out. 



(2.18) 




L (f) = 0, 
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Since <f>i is determined merely up to an element in kcr(Lo) one must add c 3 i>i + C4V2 
to it. Any component in the V2 direction, however, may be absorbed to 4>o- Hence, 
without loss of generality, we set C4 = 0. This is equivalent to fixing normalization 
in the perturbation theory for symmetric operators. 
To proceed, at the order of e 2 , 

L <fi 2 + Lx4>i + -L 2 <po = H\4>\ + ^200, 

which by the Fredholm alternative is solvable if (wi, Lq4> 2 ) — and (w 3 , £0^2) = 0. 
Substituting (2.23) we arrive at that 

c 2 (wi,£ ~ 1 (mi - £1)^2) + c 3 (wi,Li</>i) + ^c 2 (w 1 ,L2V 2 ) 

= c 2 Hi(wi,L^ ) 1 (p 1 - Lx)v 2 ) + c 3 (wi,vi) + c 2/ u 2 (wi,v 2 ), 



c 2 {w 3l L Q 1 (m - Lx)v2) + c 3 {w 3 ,L 1 (j) 1 ) + ^c 2 (w 3 ,L 2 V2) 



c 2 Hi(w 3 ,L 1 (m - Li)v 2 ) + c 3 {w 3 ,vi) + C2H2(w 3 ,v 2 ). 



Or equivalently, 
(2.24) 



'022^1 + 022M1 + C 2 2 023M1 + h 3 \ ( C2 
K a 3 2^\ + 632M1 + c 32 033M1 + °33 / \ C 3, 

where, after simplifying various inner products with the help of (2.14) and (2.19) 
and utilizing Lq 1 v 2 = w 3 by the former equation in (2.13c) and the latter equation 

-(wi,Lq 1 v 2 ) = -(wi,w 3 ) = 0, 
(wi,L 1 Lq 1 v 2 ) + (wi,Lo 1 Liw 2 ) = (wi,Liv 3 ), 

-(w 1 ,L 1 Lq 1 L 1 v 2 ) + ^(w 1 ,L 2 v 2 ), 
-(wi,vi) = -G, 
(wi,LiVi), 



in (2.22), 




(2.25a) 


«22 


(2.25b) 


b22 


(2.25c) 


C22 


(2.25(1) 


0-23 


(2.25e) 


&23 


and 




(2.25f) 


a 3 2 


(2.25g) 


b 3 2 


(2.25h) 


C32 


(2.25i) 


033 


(2.25j) 


b 33 



-(w 3 ,L 1 v 2 ) = -(103,103) = -G, 

(w 3 ,L 1 Lq 1 v 2 ) + (w 3 ,Lq 1 L 1 v 2 ) = (w 3 ,Liw 3 ) + (w2,L 1 v 2 ), 
-(■w 3 ,L 1 Lq 1 L 1 v 2 ) + ^(w3,L 2 V2), 

-(W3,Vl) = 0, 

(to 3 ,LiWi). 

Observe that (2.24) is a quadratic eigenvalue problem, which may be transformed 
into a linear matrix pencil of the form (B— [i\GA)c — 0, after the change of variables 
c 2 1 ^ — G _1 c 2 and c\ — (a 32 fii + o 32 )c 2 , so long as G ^ 0. Consequently (2.24) is 
equivalent to 

-Gc 32 6 33 ^ 

(2.26) (B - /xiGA)c := | | 1 -& 32 | - MiG | -1 | | | c 2 | = 0. 

— Gc 22 6 23/ 
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Since A is invertible, (2.24) or (2.26) is further equivalent to 

(D - nxGI)c = 0, 

where 

/ -Gc 32 b 33 \ 

(2.27) D := A X B = -1 b 32 . 

\b 22 — Gc 22 — b 22 b 32 ^23/ 

In view of (2.18) and (2.21), since e = ir and since \i\ is an eigenvalue of (2.24), 
or cquivalcntly (2.26), we determine a spectral curve of (2.10) near the origin for 
|t| small. We summarize the conclusion. 

Theorem 2.7 (Local normal form). Under Assumption 2.1, Assumption 2.2, As- 
sumption 2.5 and (2.19), three Lp er ([0,T})- eigenvalues of (2.10) in the form 

(2.28) ^(t)^G-V,t + 0(t 2 ), j = 1,2,3, 

bifurcate from zero for |r| small, where fij 's are eigenvalues o/D. 

Furthermore, a complex eigenvalue of D implies instability and the characteristic 
polynomial, or equivalently det(D — /iGI), leads to a modulational instability index. 
A straightforward calculation reveals that 



(2.29) 




dct(D - nGI) := -G'V + £>2M 2 + Din + L> , 


where 






(2.30a) 


D 2 


:= G 2 (&23 + 632) = G 2 ({wi,L 1 vi) + (w 2 ,Liv 2 ) + (w 3 ,iiw 3 )) 


(2.30b) 


Di 


:= G(&22&33 - b 23 b 32 + Gc 32 ), 


(2.30c) 


D 


:= G(c 2 2&33 - C32&23)- 



Corollary 2.8 (Modulational instability). Under Assumption 2.1, Assumption 2.2, 
Assumption 2.5 and (2.19) aperiodic traveling wave u(- ;c, a,T) of (2.1) is unstable 
to long wavelengths perturbations i/dct(D — /xGI) admits a complex root, i.e., if 
the modulational instability index 

(2.31) A := D\D\ + 4G 3 Df - 4L>^L> - 27G 6 L>^ - 18G 3 D 2 D 1 D 

is negative, where D 2 ,Di,D n are specified in (2.30a) through (2.30c) with the help 
of (2.25a)-(2.25e), (2.25f)-(2.25j). 

We therefore derive a modulational instability index in terms of various inner 
products between basis and dual basis elements of ker(L ) as well as Lq ,L\,L 2 . 
We may in turn restate the result in terms of H, P, M together with their deriva- 
tives with respect to c, a, T. 

We remark that while D is made up of terms up to second order in various inner 
products, the characteristic polynomial is homogeneous: tr(D) is linear in inner 
products, tr(D 2 ) is quadratic and det(D) is cubic. 
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2.3. Pohozaev identity techniques. One may calculate various inner products 
in (2.25a)-(2.25e) and (2.25f)-(2.25j) using definitions in (2.12a)-(2.12c) and (2.17), 
except (wi, L\Lq L\V 2 ) and (w 3 , L\Lq L\V 2 ) in (2.25c) and (2.25h). The goal of 
this subsection is to develop periodic Pohozaev-type identities, which enable us to 
calculate the stability index without recourse to inversion of L . 

Lemma 2.9 (Periodic Pohozaev-type identity). If u is T-periodic and satisfies 
(2.2) then tp :— xu x + Tu T is T-periodic and satisfies 

(2.32) L iP = L (xu x + Tu T ) = L lUx . 
If in addition u is even and satisfies Assumption 2.5 then 

(2.33) Lq 1 L 1 v 2 =^-G- 1 (w 1 ,iIj)v 1 . 
Proof. Since L u x — 0, we may write that 

Liu x = L (xu x ) - xL u x = L (xu x ) 

in the non-periodic functions setting, acting on smooth functions. Unfortunately we 
must modify it in the periodic functions setting. For one thing, although L x — xL 
is well-defined in the periodic setting, L x and xL individually arc not. Another, 
related, is that xu x is not T-periodic. Instead it develops a jump in the derivative 
over one period: 

[xu x ]l = and [{xu x ) x ]q = Tu xx (T; c, a, T). 

As noted in Remark 2.4, this is what causes ut to fail to lie in the periodic kernel of 
8 2 E. Specifically 5 2 Eut = 0, acting on smooth functions, but u T is not T-periodic. 
Rather 

[u T ]o = and [(u T )x]o = -u xx (T; a, c, T). 

We may then observe that the jump in the derivative of Tut cancels that in xu Xl so 
that xu x +Tut makes a T-periodic function. Therefore (2.32) follows. Incidentally 
the vector field xd x + Tdr corresponds to a simultaneous rescaling of space and the 
period, maintaining periodicity 

To proceed, since L^ 1 is defined up to an element in ker(To); 

Lq L1V2 = ip + CiVi + c 2 v 2 

for some ci, c 2 constants. A parity argument then dictates c 2 = 0. Since range(TQ 1 ) _L 
{wi,w 2 }, moreover, (2.33) follows upon taking the inner product against w\ and 
utilizing (2.14). □ 

Here we tacitly assume the continuity of xu x + Tut and (xu x + Tut) x across the 
period so that xu x + Tut lies in the domain of the Hamiltonian. We shall establish 
in Proposition 3.2 that a periodic traveling wave of a KdV equation with fractional 
dispersion is in fact smooth if it arises as a constrained energy minimizer. 

The apparent lack of an identity like (2.32) in higher spatial dimensions is the 
main obstruction in extending the present development to high dimensions. 

Concluding the subsection we discuss another identity, related to (2.32), which 
will be instrumental in calculating inner products involving ip — xu x + Tut in terms 
of constants of integration for the equation. 
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Lemma 2.10. If f is smooth and F' = f then 

(2.34) (/(«), V) i?er ([o,T]) = (f(u),xu x +Tu T ) =-(^J o F(u) dx)^ 

where ft = 1/T denotes the wave number. 
Proof. After integration by parts, 

(f(u),xu x +Tu T ) = / {xu x f{u{x))+Tu T f{u{x)))dx 
Jo 

= TF(u)(T) - I F(u)(x) dx + T I u T f(u)(x) dx. 
Jo Jo 

On the other hand 

(jf F(u) dx) T = F(u(T)) + J u T f{u)dx, 

whence 

(f(u),xu x + Tu T ) = T (f F ( u ) dx ) T ~ f dx 

rT . r T 



T2 ( T J nu)dx) T = -(nj o F { u)dx) Q 



□ 



3. Application: KdV equations with fractional dispersion 

We shall illustrate the results in Section 2 by discussing the KdV equation with 
fractional dispersion 

(3.1) u t - A a u x + (u 2 ) x = 0, 



where < a ^ 2 and A = y/—d x is defined via the Fourier transform as Au(£) 
|£|w(£)> representing fractional derivatives. For < a < 1, alternatively, 



r ^ 

J -oo \ x 



where PV^ stands for the Cauchy principal value and C{a) is an appropriate nor- 
malization constant. 

In the case of a = 2, notably, (3.1) recovers the KdV equation while in the case 
of a = 1 it corresponds to the Benjamin-Ono equation. In the case§ of a = —1/2, 
moreover, it was argued in [Hurl2] to approximate up to quadratic order the water 
wave problem in two spatial dimensions in the infinite depth case. Observe that 
(3.1) is nonlocal for < a < 2. Incidentally fractional powers of the Laplacian arise 
in numerous applications, such as dislocation dynamics in crystals (see [CDLFM07], 
for instance) and financial mathematics (see [CT04], for instance). 

The present treatment may be adapted mutatis mutandis to general power-law 
nonlinearities; see Remark 3.3. We focus on the quadratic nonlincarity, however, 
to simplify the exposition. Incidentally the convective acceleration is characteristic 
of many wave phenomena; we refer the reader to [Whi74] . 



§ Note that A a d x is not singular for a > — 1. 
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Throughout the section and the following, we will work in the periodic, L 2 -based 
Sobolev space setting over the interval [0, T], where T > is fixed although at times 
it is regarded as a free parameter. We define a periodic Sobolev space of fractional 
order via the norm 

ll«ll^ (M ,=/V+«A a «) dx, 

where < a < 2. We use (• , •) for the inner product on L 2 er ([0,T]). 

3.1. Periodic traveling waves of (3.1). Notice that (3.1) may be written in the 
Hamiltonian form (2.1), where J — d x and 

(3.2) H(u) = K(u) + U(u), 

(3.3) K(u) = [ \uk a u dx and U(u) = [ -^u 3 dx. 

Jo 2 J 3 

To interpret, K and U are, respectively, the kinetic energy and the potential energy. 
Notice that (3.1) possesses in addition to H two conserved quantities 

(3.4) P{u) = f \u 2 dx 

Jo 2 

and 

(3.5) M{u) = [ udx, 

Jo 

which correspond, respectively, to the momentum and the mass. Clearly H, P, M 
are smooth in i^ er ([0, T]) n ^ er ([0, T]). Since 

(3.6) 5P(u) = u and SM(u) = 1, 

moreover, iJ, P, M satisfy Assumption 2.1. In addition (3.1) is invariant under 

(3.7) u(t,x) m. X a u(X(x + x a ),X a+1 t) 

for any A > for any x G K. 

A periodic traveling wave of (3.1) takes the form u(x, t) = u(x + a;o + ct), where 
cel,i el and where u is T-periodic, satisfying by quadrature that 

(3.8) A a u - u 2 - cu - a = 

for some a £ K (in the sense of distributions). Or equivalently, 

(3.9) 5E{u; c, a) := S(H(u) - cP(u) - aM(u)) = 0. 

Henceforth we shall write a periodic traveling wave of (3.1) as u — u{- ; c, a). In a 
more comprehensive description, it is specified by four parameters c, a and T, x . 
But T > is fixed. Corresponding to the translational invariance of the equation, 
moreover, x$ may be modded out. 

A solitary wave, whose profile vanishes asymptotically, corresponds to a = and 
T = oo simultaneously. 

Clearly a periodic traveling wave of (3.1) satisfies (2.5a)-(2.5c) and (2.6). Below 
we develop integral identities that a periodic solution of (3.8), or equivalently (3.9), 
a priori satisfies and which will be useful in various proofs. 
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Lemma 3.1 (Integral identities). If u e ffp/r ([0, T]) n l| er ([0, T]) satisfies (3.8) 
i/ien 

(3.10) 2P + cM+aT = 0, 

(3.11) 2if + 3f7 - 2cP - aM = 0, 

(3.12) (a+ +2C/-cP + T^ = 0, w/iere W = TE T . 

Proof. Integrating (3.8) over [0,T] manifests (3.10). 

Multiplying (3.8) by u and integrating over [0,T] lead to (3.11). Multiplying the 
equation by xu x + Tut and integrating over [0, T], moreover, lead with the help of 
(2.34) to that 

(3.13) {a-l)K -U + cP + aM + W = 0. 

Indeed, since [d x A a } x] = (a + l)A a by brutal force, an integration by parts reveals 
that 

a — 1 



xu x A a u dx = — - — / uA a u dx. 
lo 2 J 

Combining (3.11) and (3.13) then proves (3.12). Incidentally we may write in view 
of Lemma 2.10 that 

(3.14) (A a u, if,) = (A a u, xu x + Tu T ) = olK - (SlK) a , 

where Q = l/T. □ 

In the case of a = 2, periodic traveling waves of (3.1), namely the KdV equation, 
are well known to be expressible in closed form, called cnoidal waves (see [KdV95], 
for instance). In the case of a = 1, moreover, Benjamin [Ben70] manipulated the 
Poisson summation formula and he explicitly calculated periodic traveling waves of 
(3.1). In general, the existence of periodic traveling waves of (3.1) may follow from 
variational arguments, although one may lose the explicit form of the solution. In 
the lf a / 2 -subcritical case, i.e., a > 1/3, in particular, a family of periodic traveling 
waves of (3.1) arises as energy minimizers subject to conservations of the momentum 
and the mass, generalizing ground states in the solitary wave setting. 

Proposition 3.2 (Existence, symmetry and regularity). Let 1/3 < a < 2. 

A minimizer u for H subject to that P and M are conserved exists in HpJr([0, T]) 
for each < T < oo and it satisfies (3.8) for some c / and a e R. Furthermore 
it depends upon c and a in the C 1 manner. 

Moreover u(- ; c, a) is even and strictly decreasing over the interval [0, T/2], and 
u{-;c,a)€H£ r ([0,T\). 

In other words, a family of energy minimizers for (3.8) under constraints satisfies 
Assumption 2.2. 

Proof. It suffices to take a = 0. For, otherwise, we may assume that c and M are 
of opposite sign and a > 0. In case c and M are of the same sign, noting that (3.1) 
is time reversible, 1 1-> — t in (3.1) switches the sign of c in (3.8) while leaving other 
components of the equation invariant. Once we accomplish that c and M are of 
opposite sign, a ^ in view of (3.10) since P ^ and T > by definition. We 
then devise the change of variables u h-> u + \ {y/<? + 4a — c) and rewrite (3.8) as 

(3.15) A a u — ?i 2 + "fu = 0, where 7 = \/c 2 + 4a > 0. 
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Incidentally this is reminiscent of that (3.1) enjoys the Galilean invariance under 
u(x,t) i-> u(x — Xt,t) + A for any AeR. To recapitulate, it suffices to take a = 
(and c > 0) and seek a minimizcr for H subject to constant P. 

Since -ffp/ r 2 ([0, T]) in the range a > 1/3 is compactly embedded in Lp er ([0, T]) by 
a Sobolev inequality, it is standard from calculus of variations that the minimization 
problem 

E l = mi{H(u) + P{u) : u G H%?([0, T])} 

is attained, say, at u\ € Hpl?([0, T]) and u\ satisfies (3.15) with 7 = 1 in the sense 
of distributions. The proof is rudimentary and hence we omit the detail. Thanks to 
the scaling invariance (3.7), moreover, the constrained minimization problem with 
parameter (abusing notation) P > 0, 

E = M{H(u) : u e H$£([0,T\), P(u) = P} 

is attained at u £ i?p/ r 2 ([0, T]) if and only if u(x) = A"/ 2 ui(Ax) for some constant 
A > chosen to ensure that P(u) = P. Clearly u satisfies (3.15) for some 7 > in 
the sense of distributions. The existence assertion therefore follows. It is standard 
from calculus of variations that u depends upon 7 and, in turn, c and a in the C 1 
manner. 

To proceed, since the symmetric decreasing rearrangement of u strictly decreases 
Jq uA a u dx for < a < 2 while leaving f Q T u 3 dx invariant, it follows from standard 
rearrangement arguments that a minimizer for H subject to conservations of P and 
M must symmetrically decrease away from the principal elevation. The symmetry 
and monotonicity assertion therefore follows. (Notice that unlike in the solitary 
waves setting, where a = and T = 00 simultaneously, a periodic energy minimizer 
under constraints needs not be positive everywhere.) 

It remains to address the smoothness of a periodic solution of (3.8), or equiva- 
lcntly, 



(3.16) 



(A« + 1) 



1 and after inversion. We claim that if u e ffp/^QO, T}) 



after reduction to a — 0, c 
satisfies (3.16) then u € L^ r ([0, T]). In the case of a > 1 this follows from a Sobolev 
inequality, while in the case of 1/3 < ct ^ 1 a proof based upon bounds for the 
resolvant (A Q + l)^ 1 is found in [FL12, Lemma A. 3], for instance, in the solitary 

wave setting. Specifically 



l — E L r per ([0,T}) for < a < 1 for r > j 1 ^, whence 



u e L^ r ([0,T]) after iterating (3.16) sufficiently many times. 

We then promote u e Hpl 2 ([0, T])ni^ r ([0, T]) to ff° er ([0, T]), since the Plancherel 
theorem and Young's inequality in the Fourier space manifest that 



|A Q d 



L 2 



A c 



A a + 1 



L 2 



-u*u 



L' 2 



<C\\u\\ 



<C\\u\ 



Here and elsewhere, C means a positive generic constant. Similarly 

A 2a 



\u\\ j 2 < OO. 



IIA 2 



A" + 1 



L 2 



^ C||tt|| Ll |||^rtt|| L2 < C\\u\\ L ~\\A a u\\ L2 < 00, 



and u € H™([0,T]) follows successively. 



□ 
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Remark 3.3 (Power- law nonlinearitics) . One may rerun the arguments in the 
proof of Proposition 3.2 in the case of the general power-law nonlinearity 

(3.17) u t - A a u x + {uP+% = 

and obtains a family of periodic traveling waves, where < a ^ 2 and < p < p max 
is an integer, 

if a < 1 
il a < , 

+oo il a > 1. 

Indeed they minimize in #pe / r 2 ([0,T]) the Hamiltonian 

/ f iuA a u —u p+2 ) dx 

J \2 p + 2 J 

subject to that P and M in (3.4) and (3.5), respectively, are conserved. Note that 
< p < Pmax guarantees that (3.17) is i/ Q / 2 -subcritical so that Hp,/ 2 ([0, T]) C 
LP+ 2 ([0,T]) compactly. In case p = 1, it is equivalent to a > 1/3. 

Remark 3.4 (Periodic vs. solitary waves). In the non-periodic setting, Weinstein 
in [Wci87] (see also [FL12]) demonstrated that (3.8) in the range a > 1/3 admits a 
solitary wave, for which a = and T = oo simultaneously, by seeking an optimizer 
in _ff Q / 2 (M) for the Gagliardo-Nirenberg-Sobolev inequality 

(3.19) ( / M 3 ) 2 " <C(7 uA a u)( [ uA (a ~ 1)+2a . 



If a > 1/2 so that (3.8) is L 2 -subcritical, in addition, the solitary wave further 
arises as a minimizer for the Hamiltonian subject to constant momentum and peri- 
odic constrained minimizers for (3.8), constructed via Proposition 3.2, are expected 
to tend to the solitary wave as the period increases to infinity. If 1/3 < a < 1/2, 
on the other hand, constrained energy minimizers, while they exist in the periodic 
wave setting, are unlikely to attain a limiting state with bounded energy (the H a / 2 - 
norm) at the solitary wave limit. Instead the arguments in [Wei87] will lead to a 
family of periodic traveling waves of (3.1) that each optimizes (3.19) among mean 
zero functions and which are expected to converge to the solitary wave, obtained 
in [Wei87], as the period increases to infinity. 

One is able to construct periodic traveling waves of (3.1), where a > — 1, at least 
for small amplitudes, via a perturbative method, e.g., local bifurcation theory. In 
the solitary wave setting, in contrast, Pohozaev identities techniques dictate that 
(3.8) for a 1/3 docs not admit any nontrivial solutions in H a / 2 (R) n L 3 (K). 



3.2. Nondegeneracies. Throughout the subsection let u(- ; c, a) be a periodic trav- 
eling wave of (3.1), whose existence follows from Proposition 3.2. We shall address 
Assumption 2.5. 

Clearly u(- ; c, a) satisfies (Nl) of Assumption 2.5. 

Proposition 3.5 (Nondegencracy of the linearization). Let 1/3 < a ^ 2. 

// u(- ; c, a) € HpJr{[0, T]) for some c ^ 0, a £ M and for some T > minimizes 
H subject to that P and M are conserved then the associated linearized operator 

(3.20) 8 2 E(u; c, a) = A" - 2u - c 
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acting on Lp er ([0,T]) is nondegenerate. That is to say, 

ker(5 E(u;c,a)) — spa,n{u x }. 
In other words, u(- ; c, a) satisfies (N2) of Assumption 2.5. 

The nondegeneracy of the linearization is of fundamental importance in the sta- 
bility of traveling waves and in the blowup analysis for the related, time evolution 
equation; see [Wei87,Lin08,KMRll] among others. But to establish the property is 
far from being trivial, though. As a matter of fact, one may cook up a polynomial 
nonlinearity, say, /(it) so that the kernel of —d 2 — f'(u) at the underlying wave is 
two dimensional at isolated points. 

In the case of (local) generalized KdV equations (see (2.9)), the nondegeneracy of 
the linearization at a periodic traveling wave was shown in [BJ10] to be equivalent to 
that the wave amplitude not be a critical point of the period, by means of the Sturm- 
Liouville oscillation theorems for ODEs; it was similarly verified in [Kwo89], among 
others, at ground states. Amick and Toland [AT91] elucidated the property for the 
Benjamin-Ono equation, both in the periodic and solitary wave settings, relating 
the nonlocal traveling wave equation to a fully nonlinear ODE via complex analysis 
techniques; unfortunately, their arguments are extremely specific to the Benjamin- 
Ono equation. Angulo Pava and Natali [APN08] made an alternative proof based 
upon the theory of totally positive operators, which however necessitates an explicit 
form of the solution. A satisfactory understanding of the nondegeneracy of the 
linearization therefore seems largely missing in the case of nonlocal equations. The 
main obstruction is that shooting arguments and other ODE techniques may not 
be applicable to nonlocal operators. 

Nevertheless, Frank and Lenzmann [FL12] recently demonstrated the property at 
ground states for a class of nonlinear nonlocal equations with fractional derivatives. 
Their idea lies in to find a suitable substitute for the Sturm-Liouville theory to count 
the number of sign changes in eigenfunctions of the associated linearized operator. 
Our proof of Proposition 3.5 follows along the same line as the arguments in [FL12, 
Section 3] , but with appropriate modifications to accommodate the periodic nature 
of the problem. 

Lemma 3.6 (Oscillation of eigenfunctions). Under the hypothesis of Proposition 3.5 
an eigenfunction in HpJr([0, T]) n Cp er ([0, T]) corresponding to the j-th eigenvalue 
of 5 2 E changes its sign at most j times over the periodic interval [0,T]. 

The regularity of eigenfunctions follows from the last part of Proposition 3.2; see 
also [FL12]. A thorough proof of Lemma 3.6 may be found in [FL12] in the solitary 
wave setting. Here we merely hit the main points. 

Notice that A a , < a < 2, may be viewed as the Dirichlet-to- Neumann operator 
for an appropriate (local) elliptic problem set in the periodic half strip [0,T] per x 
[0, oo). Specifically 

C(a)A a u= limy-'XO.i/), 

where w solves the elliptic boundary value problem 

1 - a 

AioH w y — in [0, T] per x (0, oo), w = u on [0, T] per x {0} 

and C(a) is an explicit constant. Accordingly one derives a variational character- 
ization of (eigenvalues and) eigenfunctions of (3.20) in terms of the Dirichlet type 
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functional 

ff |Vw(x,2/)|V~ a dxdy+ [ (-2u{x) - c)\w(x, 0)| 2 dx 

J J[0,T] per x(0,oo) JO 

in a suitable function class. The assertion then follows from nodal domain bounds 
a la Courant. 

Below we gather some, mostly elementary, facts about S 2 E. 

Lemma 3.7 (Properties of S 2 E). Under the hypothesis of Proposition 3.5 the fal- 
lowings hold: 

(LI) u x £ kcr(5 2 E); moreover it corresponds to the lowest eigenvalue of 5 2 E 

restricted to the sector of odd functions in L 2 er ([0,T}); 
(L2) n-{8 2 E) ^ 2, where n-(5 2 E) denotes the number of negative eigenvalues 

of S 2 E acting on L 2 er ([0,T}), namely the Morse index; 
(L3) l,u £ rangc((5 2 S). 

Proof. Differentiating (3.8) implies that S 2 Eu x = 0. Moreover Proposition 3.2 
implies that u may be chosen to satisfy u x (x) < for < x < T/2. On the other 
hand, the lowest eigenvalue of S 2 E acting on L 2 er odd ([0, T]) must be simple and the 
corresponding eigenfunction must be strictly positive over the interval [0,T/2]; the 
proof of such a Perron-Frobenious property is rudimentary and hence we omit the 
detail. Therefore zero is the lowest eigenvalue of S 2 E restricted to L 2 er odd ([0, T]) 
and u x is a corresponding eigenfunction. 

Since u is a minimizer for H , and in turn E, subject to conservations of P and 
M, necessarily, 

(3-21) <5 2 £|{<5P(m),<5M(u)}^ ^ 0. 

This implies by Courant's mini-max principle that 5 2 E admits at most two negative 
eigenvalues, asserting (L2). (Unlike in the solitary wave setting, where n_ (S 2 E) = 1 
at a ground state, 5 2 E may have up to two negative directions in the periodic wave 
setting. We will characterize this in Remark 3.8 below.) 

Lastly, (2.5c), (2.5b) and (3.6) verify (L3). □ 

Proof of Proposition 3. 5. Making the orthogonal decomposition 

L 2 per ([0,T}) = L 2 er , odd ([0,T]) ^ er , e „ en ([0,T]), 

since u may be chosen to be even thanks to Proposition 3.2, we find that L 2 er odd ([0, T}) 
and L 2 er ^ even ([0, T}) are invariant subspaces of S 2 E. Moreover (LI) of Lemma 3.7 
implies that 

kel ( S2E \Ll eriOdd ([0,T])) - spanK}. 
It remains to show that }tei:{8 2 E\ L 2^ e „ en ([o,T])) = {0}- 

Suppose on the contrary that there were a nontrivial function (f> £ L 2 er even ( [0 , T] ) 
such that S 2 E(f> — 0. Since 5 2 E has at most two negative eigenvalues by (L2) of 
Lemma 3.7, it follows by Lemma 3.6 that 4> changes its sign at most twice over 
the periodic interval [0,T]. Consequently either <fr is positive throughout [0,T], or 
there exists T\ £ (0,T/2) such that (f> is positive for |x| < T\ and negative for 
x £ (-T/2,T 1 ) U (T 1 ,T/2). Since (f> is in the kernel of 6 2 E, on the other hand, it 
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must be orthogonal to range((5 2 _E), and in turn to the subspace span{l,w} by (L3) 
of Lemma 3.7. In particular 

{4>, <ju-t) = for all a, r e M. 

Taking a = and r = — 1 wc find that (j> cannot be positive throughout [0,T]. In 
case 4> changes signs at x = ±Ti, noting that u is symmetrically decreasing away 
from the origin over the interval (— T/2, T/2), we may choose r e K so that u — r 
is positive in (-T 1 ,T 1 ) and negative in (-T/2,-T 1 ) U (T 1 ,T/2), deducing that 
cannot be orthogonal to {1, u}. A contradiction therefore asserts that the kernel of 
<5 2 _E must consist merely of u x . □ 

One may repeat the arguments in the proof of Proposition 3.5 mutatis mutandis 
to verify the nondegeneracy of the linearization associated with (3.17) at a periodic 
energy minimizer under constraints, in the range < a ^ 2 and < p < p max , 
where p max is in (3.18). 

One may verify (N2) of Assumption 2.5 at a periodic traveling wave of (3.1), 
a ^ —1, for small amplitudes, that follows from, e.g., a local bifurcation theorem 
from a simple eigenvalue, by explicitly calculating the asymptotic expansion of the 
solution. 

Remark 3.8 (The Morse index). We make a digression and characterize ri-(5 2 E) 
at a periodic energy minimizer for (3.8) under constraints. We begin by recalling 
an index formula. 

Lemma 3.9 (An index formula). Let JC be a self-adjoint operator, bounded below 
and invertible with compact resolvant. Let S be a finite- dimensional subspace of the 
domain of K- and let IC\s denote the symmetric restriction of fC to S. That is to 
say, K\s = HsJCHs, where Us is the orthogonal projection onto S. Then 

(3.22) n_(£) =n_(/C|s)+n-(/C- 1 | s _ L ). 

This explains that the inertia of a matrix is linear under the Schur complement. 
Various forms of (3.22) are known in the nonlinear waves community; see [KP12, 
CPV05, GSS87], for instance. See also [Hay68] for discussion in finite dimensions. 
We include a proof in Appendix A for completeness. 

We are going to restrict the attention to the orthogonal complement of u x , which 
contains 1 and u. Since u x lies in the kernel of S 2 E, such restriction does not change 
n-(S 2 E). Moreover S 2 E is invertible on {tij} 1 . Taking S = {1, u} 1 - we apply (3.22) 
and write that 

n.(5 2 E) = n_(5 2 E\ {hu} ±) + n.((5 2 E)-% M ). 

Note from (3.21) that n_(<5 2 E\ {1>u} ±) = 0. Moreover note from (2.5c) and (2.5b) 
that (S 2 E)^ 1 1 = u a and (S 2 E)~ 1 u = u c , where 1 and u are in general not orthogonal 
but by Sylvester's law of inertia, 

A Sturm sequence argument then leads to that 

(3.23) n_(S 2 E) = # sign changes in 1, M a , M a P c - M c P a . 

This furnishes an alternative characterization of n_ (S 2 E). It is particularly useful in 
practice since the signs of M a and G = M c P a — M a P c may be explicitly determined 
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in the solitary wave limit (see Lemma 3.10 below) and in the small amplitude wave 
limit, as well as for ODEs. 

Since u x (0) = and u x (0) < for < x < T/2 by Proposition 3.2, a Perron- 
Frobenious argument asserts that 5 2 E must admit at least one negative eigenvalue 

that lies in L 2 even ([0,T]). Therefore (^f ) a cannot be positive definite. 



per,even\r' J/ - ^±^1.^^+^ \P P 

We turn the attention to (N3) of Assumption 2.5. 

Lemma 3.10 (Nondcgcncracy of the constraint set). Let 1/2 < a ^ 2. 

If u(- ; c, a) G Hplr{[§, T\) for some c ^ 0, a £ R and T > minimizes H subject 
to that P and M are conserved then M a < and G > for \a\ sufficiently small 
and T sufficiently large. 

Proof. Noting that the period T > is arbitrary in the proof of Proposition 3.2, we 
recall from Remark 3.4 that u(- ;c,a,T) tends to the solitary wave of (3.1) in the 
solitary wave limit, as a — > and T — » oo simultaneously. Thanks to the scaling 
invariance (3.7), we may assume without loss of generality that c = 1. Indeed (3.8) 
remains invariant under 

u(- ; c, a, T) ^ c _1 m(- ; 1, cT 2 a, c~ 1/q T). 

Accordingly 

P(l, a, T), M(l, a, T), P c (l, a, T), M c (l, a, T) = 0(1) 

for |a| sufficiently small and T > sufficiently large. Differentiating (3.10) with 
respect to a and evaluating at the solitary wave limit, we use (2.6) to find that 

M a = —T — 2M C = -T + 0(1) < 

for T sufficiently large. Since an explicit calculation reveals that P c (u(- ; c, a, T j) > 
for |a| sufficiently small and T sufficiently large, it follows that 

G = Ml - M a P c = P C T + 0(1) > 

near the solitary wave limit. □ 

In case a ^ 1/2 so that (3.8) is L 2 -supercritical, periodic energy minimizers 
under constraints are not expected to attain a limiting state as a — >• and T — > oo 
simultaneously, with bounded energy (the H a / 2 -noim). Nevertheless one may verify 
(N3) of Assumption 2.5 at least at small amplitude waves, constructed via a local 
bifurcation theorem, by explicitly calculating the asymptotics of the solution. 



3.3. Calculation of the modulational instability index. Let u(- +x ;c, a,T) 
be a T-periodic, traveling wave solution of (3.1), satisfying that 

(3.24) A a u - u 2 - cu - a = 0, 

whose existence follows either from Proposition 3.2 or via local bifurcation theory. 
Let u satisfy Assumption 2.2 and Assumption 2.5. We shall take the approach in 
Section 2 to studying the associated spectral problem 

(3.25) nv = L a (u; c, a)v := d x (A a -2u- c)v 

and determine an instability with respect to long wavelengths perturbations. Specif- 
ically we shall determine the modulational instability index A in (2.31) in terms of 
U, P, M as functions of c and a. Incidentally U, P, M correspond to the third, the 
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second and the first momenta, respectively. We may restate the result in terms of 
H, P, M, noting from (3.2) and (3.11) that 

K = 3H — 2cP - aM and U = -2H + 2cP + aM. 

In the forthcoming section we shall determine the modulational instability index in 
the case of the general nonlinearity, in terms of K and U, P, M together with their 
derivatives with respect to c, a as well as T _1 . 

We may invoke the results of Corollary 2.8 to express the modulational instability 
index in terms of various inner products between 

(3.26a) vi = u a , W\ = M c u — P c , 

(3.26b) v 2 = u x , w 2 = d^iMaUc - M c u a ), 

(3.26c) v 3 = u c , w 3 — P a - M a ii 

as well as Lq 1 and 

(3.27) Li(u; c, a) =[L , x] = (a+ l)A a -2u-c, 

L 2 (u; c, a) =[Li,x] = a(a + l)A a ~ 2 d x . 

Notice that 

(vj,w k ) = {M,P} c .J jk = GS jk , 
where we recall the notation 

{fjd}x,y = fx9y ~ fy9x 

and that Sj k = 1 if j = k, Sj k = otherwise. 

We begin by rewriting (wj,Liv k ), j,k — 1, 2, 3, in terms of U, P, M. In view of 

(3.27) we use (3.12) and (3.24) to calculate that 

Liu =(a + l)A a u - 2u 2 - cu =(a + 1)6K + 2SU - c5P = -SW 

(3.28) =(1 - a)SU + acSP + {a + l)aSM 

and 

(3.29) Lil = (a + 1)A"1 -2u-c= -{25P + cSM). 

Since L\ is self-adjoint, we use (3.26a) and (3.28), (3.29) to obtain that 

(tui,LiUi) ={LxW\,v{) 
(3.30a) =M C ((1 - a)U a + acP a + (a + l)oM„) + P c (2P a + cM a ). 

Similarly, 

(3.30b) (w u L lV3 ) = M c ((l - a)U c + acP c + (a + l)oM c ) + P C (2P C + cM c ), 
(3.30c) (w 3 , Livi) = - Af„((l - a)U a + acP a + (a + l)oM„) - P a {2P a + cM a ), 
(3.30d) (w 3 ,L lV3 ) = - M„((l - a)U c + acP c + (a + l)oM c ) - P a (2P c + cM c ). 

Therefore 

(3.31) (w u L lVl ) + (w 3 ,L lV3 ) = (1 - a){{M, U} c>a - cG). 
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Moreover we use (3.26b) to calculate that 

(w 2 ,L 1 v 2 ) ^{d x 1 {M a u c - M c u a ),Liu x ) 

={d-\M a u c - M c u a ),d x ({a + l)A a -u- c)u) 
= - (M a u c - M c u a , -a5U + acSP + (a + l)a5M) 

(3.32) =-a({M,U} c , a -cG). 

Therefore, we calculate in view of (2.30a) that 



(3.33) D 2 = G 2 (l-2a){{M,U} c . a -cG) 



Calculations of c 22 and C32 in (2.25c) and (2.25h) are involved. As a preliminary, 
we combine a periodic Pohozaev-type identity and the scaling invariance to express 
Lq 1 Liv 2 in a convenient form. 

Lemma 3.11. It follows that 

(3.34a) Lq X Lxv 2 = - au + G _1 (w 2l Liv 2 )v 3 + aG~ 1 ((wi 1 u)vi + (w 3 ,u)v 3 ) 
(3.34b) = - au + aG- 1 {2M c P - P c M)v x - acv 3 . 

Proof. Note from the scaling invariance (3.7) that if u(x; c, a, T) satisfies (3.8) then 
so does \ a u(Xx; X a c, A 2a a, AT) for any A > 0. Differentiating 

6E(\ a u(\x; A Q c, A 2 "a, AT)) = 

with respect to A and evaluating at A = 1 we obtain that 

6 2 E(au + xu x + acu c + 2aau a + Tut) = 0. 

In other words, au + 2aau a + acu c + xu x + Tut is in the kernel of 5 2 E. The result 
of Proposition 3.5, on the other hand, states that kei(S 2 E) is one-dimensional and 
spanned merely by u x , which is odd. Since au + 2aau a + acu c + xu x + Tut is even, 
it must be zero. To summarize, xu x + Tut = —a(u + 2au a + cu c ). 
Therefore, we infer from (2.32) that 

Liv 2 = L (-a(u + 2avi + cv 3 )). 

Consequently 

Lq 1 Liv 2 = —au + C1V1 + c 3 v 3 

for some c\ G C a constant and c 3 = —ac. Indeed, ker(L ) = span{wi,w 2 } but v 2 
is odd. Taking inner products against w\ and w 3 then leads to that 

(3.35) = — a(u>i,u) + C\G and (w 2 , Liv 2 ) = —a(w 3 , u) + c 3 G. 

Therefore (3.34a) follows. Moreover (3.34b) follows, noting that 

(wt , u) = 2M C P - P C M and (w 3 ,u) = P a M - 2M a P. 

□ 

In the case of the general power-law nonlinearity (see (3.17)) the equation enjoys 
a scaling invariance, and one may repeat the proof of Lemma 3.11 mutatis mutandis 
to calculate Lq 1 Liv 2 in the form (3.34a). 

Incidentally, the latter equation in (3.35) offers with the assistance of (3.32) that 
{M, U} c , a = 2cG + P a M - 2M a P. 
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Introducing 



5V =aL\U + —L 2 u x = a(^ — (a + l)A a u — 2u 2 — cu^j 



= -a((a - 3)u 2 + (a- l)cu + (a + l)a), 



(3.36) 

we use (3.34a) to revamp C22 in (2.25c) as 

C22 ={wi,aLiu) - G _1 (w 1 ,L 1 (w 2 ,L 1 v 2 )v 3 ) 



- aG^ 1 (wi, Li((wi, u)vi + (w 3 ,u)v 3 )) + -(wi,L 2 v 2 ) 

(3.37) =-G- 1 (w 2 ,L 1 v 2 )(w 1 ,L 1 v 3 ) + d 22 , 
where a straightforward calculation reveals that 

(3.38) d 22 :=(ioi, SV) - aG^ 1 ((w 1 ,u)(w 1 ,L 1 v 1 ) + (w 3 ,u)(w 1 ,L 1 v 3 )) 

=^a(M c (3(3 - a)U + 2{a - l)cP +(a + l)aM) 
- P c (2(a - 3)P +{a- l)cM + {a + l)a)) 

- a(l - a)G- 1 (2M c P{M, U} c . a - M C M{P, U} c . a ) 

- a(2acM c P + AP C P + (a + l)aaM c M + cP c M). 



Correspondingly 

(3.39) c 32 : 
where 

(3.40) d 32 : 



G 1 (w 2 ,L 1 v 2 )(w 3 ,L 1 v 3 ) + d 32 , 



--(w 3 ,SV) - a.G 1 ((wi,u)(w 3 ,L 1 vi) + (w 3 ,u)(w 3 ,L 1 v 3 )) 

= ^a(P a (2(a - 3)P + (a - l)cM + (a + l)a) 

- 2M a (3(3 - a)U + 2 (a - l)cP + (a + l)aM)) 
+ a(l - a)G- 1 (2M a P{M, U} c , a - M a M{P, U} c , a ) 
+ a(2acM a P + AP a P + (a + l)aaM a M + cP a M). 
Since a straightforward calculation reveals that 
{w\,L\v 3 ){w 3 ,Liv\) - (wi,L 1 vi)(w 3 ,Liv 3 ) 
(3.41) = (l-a)G(2{P, U} c . a + c{M, U} c , a ) - G{2{a + l)a - ac 2 ) =: I\ 
we use (3.37), (3.39) and calculate in view of (2.30b), (2.30c) that 
Di =G((w 1 ,L 1 v 3 )(w 3 ,L 1 v 1 ) - (w 1 ,L 1 v 1 )(w 3 ,L 1 v 3 ) 

- (w 2 ,L 1 v 2 ) {{w\,Lwi) + (tU3,Liv 3 )) - Gd 32 ) 



(3.42) 
and 



(3.43) 



a(l - a)({M, U} c<a - cG) 2 + G(T - d 32 ) 



D a =(w 2 , Liv 2 )((wi, Livi)(w 3l Liv 3 ) - (wi, Liv 3 )(w 3 , Livi)) 
+ G((w 3 ,Livi)d 22 - {wi,Livi)d 32 ) 



aT({M, U} c . a - cG) + G{{w 3 ,L lV i)d 22 - (m, L lVl )d 32 ) 
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where (wi, Livi), W3, Livi) and (I22, ^32 are specified in (3.30a), (3.30c) and (3.38), 
(3.40), respectively, in terms of U, P, M as functions of c, a. 

To summarize, the modulational instability index for a periodic traveling wave 
of (3.1) is calculated as the discriminant of the cubic polynomial 

det(D - uGl) = -GV + £>2M 2 + D lfJ , + D a , 

where D 2 , D\, D are specified in (3.33), (3.42), (3.43), respectively, in terms of 
U, P, M as functions of c, a. 

Notice that the characteristic polynomial may be further written with the help 
of Lemma 3.11 as 



(3.44) det(D - fiGT) = 



\wz,LiVz) -Gn Gd 32 (w 3 ,L 1 vi) 

1 (w2,L 1 v 2 ) - Gfi 

{w\,LiVs) Gd 2 2 (wi,Llvi) -GfM 



One may repeat the arguments leading to (3.43) or (3.44) mutatis mutandis to 
determine the spectral stability near the origin of a periodic traveling wave of (3.17) 
to long wavelengths perturbations. 



4. Application: general nonlinearities 

We shall discuss how the developments in Section 2 and Section 3 may be adapted 
to the generalized KdV equation with fractional dispersion 

(4.1) ut - A a u x + f(u) x = 0, 
where < a < 2 and / is a smooth nonlinearity. 

Notice that (4.1) possesses three conserved quantities (abusing notation) 

(4.2) H(u) = {^uA a u - F(u)) dx =: K{u) + U(u), 
where F' = f, and 

(4.3) P(u) = l -u 2 dx, 

(4.4) M{u) = f udx, 

Jo 

which correspond to the Hamiltonian and the momentum, the mass, respectively. 
We refer to K and U as the kinetic energy and the potential energy, respectively. 
Throughout the section we will use H, K, U and P, M for those in (4.2) and (4.3), 
(4.4), respectively. Obviously (4.1) is in the Hamiltonian form (2.1), where J = d x . 
Notice that H, P, M are smooth in an appropriate subspace of Hp er ([0,T]) and 
translationally invariant. Thanks to (3.6), hence, H,P,M satisfy Assumption 2.1. 

Assume that (4.1) admits a smooth, four-parameter family of periodic traveling 
waves, denoted u(- + xq; c, a, T), where c and a form an open set in R 2 , xq G M and 
T > are arbitrary, and where u is even and T-periodic, satisfying by quadrature 
that 



(4.5) 



A a u - f(u) - cu - a = 
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for some c and a (in the sense of distributions) . Or equivalently, it satisfies (abusing 
notation) that 

(4.6) 5E{u; c, a) := 5{K{u) + U{u) - cP{u) - aM{u)) = 0. 

For a broad range of nonlinearities, the existence of periodic traveling waves of (4.1) 
usually follows from variational arguments, e.g., the mountain pass theorem applied 
to a suitable variational problem whose Euler-Lagrange equation is (4.5). We shall 
determine the spectral instability of u(- + x ;c, a,T) near the origin with respect 
to long wavelengths perturbations. We assume that it satisfies Assumption 2.5. 

One may follow the arguments leading to the results in Corollary 2.8 and derive 
the modulational instability index A in (2.31) in terms of various inner products 
between (abusing notation) 

vi = u a , wi = M c u - P c , 

v 2 = u x , w 2 = d~ 1 (M a u c - M c u a ), 

v 3 = u c , w 3 = P a - M a u, 

as well as 

(4.7a) L =d x (A a -f'(u)-c), 
(4.7b) Lx =(a + l)A a - /'(«) - c, 

(4.7c) L 2 =a(a + l)A a ~ 2 d x . 

We shall further express inner products in terms of K and U, P, M together with 
their derivatives with respect to c, a as well as = 1/T. Below we develop integral 
identities that a periodic solution of (4.5), or equivalently (4.6), a priori satisfies 
and which will be useful in various proofs. 

Lemma 4.1 (Integral identities). If u satisfies (4.5) (in the sense of distributions) 
then 

(4.8) f f(u) dx + cM + aT = 0, 

(4.9) 2K- [ uf(u) dx - 2cP - aM = 0, 

Jo 

(4.10) (a-l)K- I F(u) dx + cP + aM + TE T = 0. 

Jo 

Multiplying (4.5) by 1, u and xu x +Tut, respectively, and integrating over [0, T], 
the proof is very similar to that of Lemma 3.1. Hence we omit the detail. 

In the case of power-law nonlinearities, uf{u) and F(u) are proportional, whereby 
one may relate the kinetic energy, for instance, to the potential energy and the mo- 
mentum, the mass. See the previous section. In the case of general nonlinearities, 
where scaling invariance is lost, on the other hand, the kinetic and the potential 
energies and the momentum, the mass are no longer linearly dependent and the 
modulational instability index will involve K and U,P,M. Furthermore derivatives 
with respect to c, a and T are not linearly dependent. Therefore the stability index 
will involve K, U, P, M together with their derivatives with respect to c, a, T _1 . 
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We shall rewrite (wj,L\Vk), where j, k = 1, 2, 3 and j + k is odd, in terms of K 
and U, P, M as functions of c, a and T. Note that 

L lU = (a + l)A a u- f'{u) -cu and L x \ = -f'{u) - c. 

Differentiating (4.9) and (4.8) with respect to a we obtain that 

2K a + U a - I uf(u)u a dx - 2cP a - (aM) a 
Jo 

=K a + E a - uf'(u)u a dx - cP a = 0, 
Jo 

where we recall from (4.6) that E = K + U — cP — aM, and 

/ /'(«)«„ dx + cM a + T = 0, 
Jo 

respectively. Since L\ is self-adjoint, we then calculate that 

=(LiWi,Vi) = M c {Liu,u a ) - P c (Lil,u a ) 
=M c ((a + l)K a -K a -E a + cP a - cP a ) - P C T 

(4.11a) =M c (aK a - E a ) - P C T. 

Similarly, 

(4.11b) (w u L lV3 ) = M c (aK c - E c + P) - P C M, 

(4.11c) (W3,L 1V1 ) - - M a (aK a - E a ) + P a T, 

(4.11d) (W3,L 1V3 ) = - M a (aK c -E c + P) + P C M. 

Moreover 

(W2,L 1V 2) ={d-\M a u c - M c u a ), ((a + l)A a - f'(u) - c)u x ) 

(4.12) =-a({M,U} c , a -cG). 

To proceed, it is straightforward that 

(4.13) (w u L 2 v 2 ) = -2a(a + 1)M C K and (w 3 , L 2 v 2 ) = 2a(a + l)M a K, 

while since differentiating (4.9) and (4.8) in xd x + Tdr leads with help of (2.34) 
and (3.14) to that 

2aK - 2{QK) n - (QU) a - [ uf'(u)(xu x + Tu T ) dx + 2c(OP) n + a(flM) n 

Jo 

= 2aK - (QK) n - (Q£) n - f uf{u){xu x + Tu T ) dx + c{QP) n = 

Jo 

and 

/ f'{u){xu x + Tu T ) dx - c(VLM) n = 0, 
Jo 

respectively, we calculate in view of (2.33) that 

(w 1 L 1 Lq 1 L 1 v 2 ) =(L 1 w 1 ,ip) - G^ 1 (w 1 ,ip)(L 1 w 1 ,v 1 ) 
(4.14a) =M c {a(a - l)K - (Q(aK - E)) n ) 

- G'\M c {nP) n - P c (nM) n )(M c (aK a - E a ) - P C T). 
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Similarly 

(w 3 ,LiLo 1 L 1 v 2 ) =(£iw 3 » - G~ 1 (wi,'ip)(L 1 w s ,vi) 
(4.14b) = - M a {a(a - l)K - (Q(aK - E)) n ) 

+ G-\M c (SlP) a - P c (nM) n )(M a (aK a - E a ) - P a T). 

To summarize, the "effective dispersion matrix" in (2.27) is given by 







D 12 




H 






° 




\D 31 


D32 


D 33 l 



where, using (4.11a)-(4.11d), (4.12) and (4.13), (4.14a), (4.14b), 
.Dia = - 2a 2 GM a K - G(fl(aK - E)) a 

+ M c ((nP) n - P c (nM) n )(M a {aK a - E a ) - P a T), 
£13 = - M a (aK a - E a ) + P a T, 

D22 = - a({M, U} c , a - cG) - M a (aK c -E c + P) + P a M, 
D31 =M c (aK c -E c + P)- P C M, 
D 32 =2a 2 GM c K - G(Q(aK - E)) n 

- M c (nP) n - P c ({lM) Q )(M c (aK a - E a ) - P C T) 

+ (M c (aK c -E c + P)- P C M) 

■ {a{M, U} c , a -cG + M a (aK c -E c + P)+ P C M), 

D 33 =M c (aK a - E a ) - P C T. 

Moreover a complex eigenvalue of D implies instability and the characteristic poly- 
nomial, or equivalently det(D — /xGI), leads to the modulational instability index. 



Appendix A. Proof of Lemma 3.9 

We first prove (3.22) in finite dimensions. Recall from the Jacobi-Sturm sequence 
argument that the number of negative eigenvalues of an nxn matrix M = (mij)™j_ 1 
is equal to the number of sign changes in the sequence 

(A.l) l,TOi,TO 2 ,m3,...,m n , 

where nik is fc-th principal minor, defined as 

TO fe = det(m,ij)l j=1 . 

Recall a duality formula for minor determinants: let / and J be subsets of {1, 2, . . . , n} 
of size k, i.e., |/| = |J| = k, and let 

det(M) = dot;///,., i, /.,. ./. 

If J' denote the complementary sets to /, J then 

(A.2) „(»,-.)- (-l,<E-.«-^i)!!^fi. 

A proof based upon the Schur complement formula is found in [ScrlO, pp. 41], 
for instance. This illustrates that inverse matrices take fc-minor determinants to 
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complementary (n — fc)-minor determinants, similarly to that the Hodge-* operator 
acts on fc-forms. 

Suppose that ei, £2, . . . e„ form a basis of W 1 and e\, e%, . . . form a basis of S 1 . 
By the Jacobi-Sturm sequence argument the number of negative eigenvalues of M 
is equal to the number of sign changes in 

l,mi,TO 2 , • • • ,m n , 

and the number of negative eigenvalues of M|g is, similarly, equal to the number 
of sign changes in 

1, mi, m 2 , . . . ,77ifc. 

By (A. 2), moreover, the number of negative eigenvalues of (M" 1 )^ is 

m n _i m n _ 2 m k 
m n ' m n ' " ' ' m„ ' 

Therefore (3.22) follows. 

To proceed, let M be invcrtible and bounded below with compact resolvant. Let 
Ai ^ A 2 $5 A3 . . . denote eigenvalues of M, and vi, V2, V3, . . . be the corresponding 
eigenvectors. Let S n denote the subspace spanned by vi, V2, ■ ■ ■ , v n and S and let 
M„ = Hs n MHs n denote the symmetric projection of M onto S n . Then, 

(Ml) M„ — > M as n — > 00 in the strong operator topology and n_(M„) = 

n_ (M) for n sufficiently large; 
(M2) If M is invertible then M„ : S n — > S n is invertible for n sufficiently large; 
(M3) (M„) _1 -4- M _1 in the uniform operator topology and n_ ((M„) _1 = 

n_(M _1 | S i) for n sufficiently large; 
(M4) M\ s = M n \ s . 
Therefore (3.22) follows from a limiting argument. 
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